Pandas Profiling Report

Dataset statistics

Number of variables	14
Number of observations	891
Missing cells	687
Missing cells (%)	5.5%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	381.0 KiB
Average record size in memory	437.9 B

Variable types

CAT	7
NUM	6
BOOL	1

Reproduction

Analysis started	2020-05-18 18:26:38.907414
Analysis finished	2020-05-18 18:26:47.434904
Duration	8.53 seconds
Version	pandas-profiling v2.7.1
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

`Cabin` has a high cardinality: 147 distinct values	High cardinality
`Name` has a high cardinality: 891 distinct values	High cardinality
`Ticket` has a high cardinality: 681 distinct values	High cardinality
`Title` is highly correlated with `Sex`	High correlation
`Sex` is highly correlated with `Title`	High correlation
`Cabin` has 687 (77.1%) missing values	Missing
`Cabin` is uniformly distributed	Uniform
`Name` is uniformly distributed	Uniform
`PassengerId` is uniformly distributed	Uniform
`Ticket` is uniformly distributed	Uniform
`Name` has unique values	Unique
`PassengerId` has unique values	Unique
`Fare` has 15 (1.7%) zeros	Zeros
`Parch` has 678 (76.1%) zeros	Zeros
`SibSp` has 608 (68.2%) zeros	Zeros
`Family_Size` has 537 (60.3%) zeros	Zeros

Age
Real number (ℝ_≥0)

Distinct count	89
Unique (%)	10.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	29.44519640852974
Minimum	0.42
Maximum	80.0
Zeros	0
Zeros (%)	0.0%
Memory size	7.1 KiB

Quantile statistics

Minimum	0.42
5-th percentile	5
Q1	22
median	30
Q3	35.5
95-th percentile	54
Maximum	80
Range	79.58
Interquartile range (IQR)	13.5

Descriptive statistics

Standard deviation	13.24489592
Coefficient of variation (CV)	0.4498151663
Kurtosis	0.7882478756
Mean	29.44519641
Median Absolute Deviation (MAD)	8
Skewness	0.4328988034
Sum	26235.67
Variance	175.4272679

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
30	144	16.2%
22	63	7.1%
24	30	3.4%
18	26	2.9%
28	25	2.8%
19	25	2.8%
21	24	2.7%
25	23	2.6%
36	22	2.5%
29	20	2.2%
Other values (79)	489	54.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.42	1	0.1%
0.67	1	0.1%
0.75	2	0.2%
0.83	2	0.2%
0.92	1	0.1%

Value	Count	Frequency (%)
80	1	0.1%
74	1	0.1%
71	2	0.2%
70.5	1	0.1%
70	2	0.2%

Cabin
Categorical

HIGH CARDINALITY
MISSING
UNIFORM

Distinct count	147
Unique (%)	72.1%
Missing	687
Missing (%)	77.1%
Memory size	7.1 KiB

B96 B98	4
G6	4
C23 C25 C27	4
C22 C26	3
D	3
Other values (142)	186

Value	Count	Frequency (%)
B96 B98	4	0.4%
G6	4	0.4%
C23 C25 C27	4	0.4%
C22 C26	3	0.3%
D	3	0.3%
F2	3	0.3%
E101	3	0.3%
F33	3	0.3%
D20	2	0.2%
D36	2	0.2%
Other values (137)	173	19.4%
(Missing)	687	77.1%

Length

Max length	15
Mean length	3.134680135
Min length	1

Value	Count	Frequency (%)
Decimal_Number	10	47.6%
Uppercase_Letter	8	38.1%
Lowercase_Letter	2	9.5%
Space_Separator	1	4.8%

Value	Count	Frequency (%)
Common	11	52.4%
Latin	10	47.6%

Value	Count	Frequency (%)
ASCII	21	100.0%

Embarked
Categorical

Distinct count	3
Unique (%)	0.3%
Missing	0
Missing (%)	0.0%
Memory size	7.1 KiB

S	645
C	169
Q	77

Value	Count	Frequency (%)
S	645	72.4%
C	169	19.0%
Q	77	8.6%

Length

Max length	1
Mean length	1
Min length	1

Value	Count	Frequency (%)
Uppercase_Letter	3	100.0%

Value	Count	Frequency (%)
Latin	3	100.0%

Value	Count	Frequency (%)
ASCII	3	100.0%

Fare
Real number (ℝ_≥0)

ZEROS

Distinct count	248
Unique (%)	27.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	32.204207968574636
Minimum	0.0
Maximum	512.3292
Zeros	15
Zeros (%)	1.7%
Memory size	7.1 KiB

Quantile statistics

Minimum	0
5-th percentile	7.225
Q1	7.9104
median	14.4542
Q3	31
95-th percentile	112.07915
Maximum	512.3292
Range	512.3292
Interquartile range (IQR)	23.0896

Descriptive statistics

Standard deviation	49.6934286
Coefficient of variation (CV)	1.543072528
Kurtosis	33.39814088
Mean	32.20420797
Median Absolute Deviation (MAD)	6.9042
Skewness	4.78731652
Sum	28693.9493
Variance	2469.436846

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
8.05	43	4.8%
13	42	4.7%
7.8958	38	4.3%
7.75	34	3.8%
26	31	3.5%
10.5	24	2.7%
7.925	18	2.0%
7.775	16	1.8%
26.55	15	1.7%
0	15	1.7%
Other values (238)	615	69.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	15	1.7%
4.0125	1	0.1%
5	1	0.1%
6.2375	1	0.1%
6.4375	1	0.1%

Value	Count	Frequency (%)
512.3292	3	0.3%
263	4	0.4%
262.375	2	0.2%
247.5208	2	0.2%
227.525	4	0.4%

Name
Categorical

HIGH CARDINALITY
UNIFORM
UNIQUE

Distinct count	891
Unique (%)	100.0%
Missing	0
Missing (%)	0.0%
Memory size	7.1 KiB

de Messemaeker, Mrs. Guillaume Joseph (Emma)	1
Oreskovic, Mr. Luka	1
Dorking, Mr. Edward Arthur	1
Balkic, Mr. Cerin	1
Hocking, Mr. Richard George	1
Other values (886)	886

Value	Count	Frequency (%)
de Messemaeker, Mrs. Guillaume Joseph (Emma)	1	0.1%
Oreskovic, Mr. Luka	1	0.1%
Dorking, Mr. Edward Arthur	1	0.1%
Balkic, Mr. Cerin	1	0.1%
Hocking, Mr. Richard George	1	0.1%
Ostby, Mr. Engelhart Cornelius	1	0.1%
Foreman, Mr. Benjamin Laventall	1	0.1%
Brown, Miss. Amelia "Mildred"	1	0.1%
Ivanoff, Mr. Kanio	1	0.1%
Barbara, Mrs. (Catherine David)	1	0.1%
Other values (881)	881	98.9%

Length

Max length	82
Mean length	26.96520763
Min length	12

Value	Count	Frequency (%)
Lowercase_Letter	26	43.3%
Uppercase_Letter	25	41.7%
Other_Punctuation	5	8.3%
Space_Separator	1	1.7%
Dash_Punctuation	1	1.7%
Open_Punctuation	1	1.7%
Close_Punctuation	1	1.7%

Value	Count	Frequency (%)
Latin	51	85.0%
Common	9	15.0%

Value	Count	Frequency (%)
ASCII	60	100.0%

Parch
Real number (ℝ_≥0)

ZEROS

Distinct count	7
Unique (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.38159371492704824
Minimum	0
Maximum	6
Zeros	678
Zeros (%)	76.1%
Memory size	7.1 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	2
Maximum	6
Range	6
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.8060572211
Coefficient of variation (CV)	2.112344071
Kurtosis	9.778125179
Mean	0.3815937149
Median Absolute Deviation (MAD)	0
Skewness	2.749117047
Sum	340
Variance	0.6497282437

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	678	76.1%
1	118	13.2%
2	80	9.0%
5	5	0.6%
3	5	0.6%
4	4	0.4%
6	1	0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	678	76.1%
1	118	13.2%
2	80	9.0%
3	5	0.6%
4	4	0.4%

Value	Count	Frequency (%)
6	1	0.1%
5	5	0.6%
4	4	0.4%
3	5	0.6%
2	80	9.0%

PassengerId
Real number (ℝ_≥0)

UNIFORM
UNIQUE

Distinct count	891
Unique (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	446.0
Minimum	1
Maximum	891
Zeros	0
Zeros (%)	0.0%
Memory size	7.1 KiB

Quantile statistics

Minimum	1
5-th percentile	45.5
Q1	223.5
median	446
Q3	668.5
95-th percentile	846.5
Maximum	891
Range	890
Interquartile range (IQR)	445

Descriptive statistics

Standard deviation	257.353842
Coefficient of variation (CV)	0.5770265516
Kurtosis	-1.2
Mean	446
Median Absolute Deviation (MAD)	223
Skewness	0
Sum	397386
Variance	66231

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
891	1	0.1%
293	1	0.1%
304	1	0.1%
303	1	0.1%
302	1	0.1%
301	1	0.1%
300	1	0.1%
299	1	0.1%
298	1	0.1%
297	1	0.1%
Other values (881)	881	98.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1	0.1%
2	1	0.1%
3	1	0.1%
4	1	0.1%
5	1	0.1%

Value	Count	Frequency (%)
891	1	0.1%
890	1	0.1%
889	1	0.1%
888	1	0.1%
887	1	0.1%

Pclass
Categorical

Distinct count	3
Unique (%)	0.3%
Missing	0
Missing (%)	0.0%
Memory size	7.1 KiB

3	491
1	216
2	184

Value	Count	Frequency (%)
3	491	55.1%
1	216	24.2%
2	184	20.7%

Length

Max length	1
Mean length	1
Min length	1

Value	Count	Frequency (%)
Decimal_Number	3	100.0%

Value	Count	Frequency (%)
Common	3	100.0%

Value	Count	Frequency (%)
ASCII	3	100.0%

Sex
Categorical

HIGH CORRELATION

Distinct count	2
Unique (%)	0.2%
Missing	0
Missing (%)	0.0%
Memory size	7.1 KiB

male	577
female	314

Value	Count	Frequency (%)
male	577	64.8%
female	314	35.2%

Length

Max length	6
Mean length	4.704826038
Min length	4

Value	Count	Frequency (%)
Lowercase_Letter	5	100.0%

Value	Count	Frequency (%)
Latin	5	100.0%

Value	Count	Frequency (%)
ASCII	5	100.0%

SibSp
Real number (ℝ_≥0)

ZEROS

Distinct count	7
Unique (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.5230078563411896
Minimum	0
Maximum	8
Zeros	608
Zeros (%)	68.2%
Memory size	7.1 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	3
Maximum	8
Range	8
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.102743432
Coefficient of variation (CV)	2.108464374
Kurtosis	17.88041973
Mean	0.5230078563
Median Absolute Deviation (MAD)	0
Skewness	3.695351727
Sum	466
Variance	1.216043077

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	608	68.2%
1	209	23.5%
2	28	3.1%
4	18	2.0%
3	16	1.8%
8	7	0.8%
5	5	0.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	608	68.2%
1	209	23.5%
2	28	3.1%
3	16	1.8%
4	18	2.0%

Value	Count	Frequency (%)
8	7	0.8%
5	5	0.6%
4	18	2.0%
3	16	1.8%
2	28	3.1%

Survived
Boolean

Distinct count	2
Unique (%)	0.2%
Missing	0
Missing (%)	0.0%
Memory size	7.1 KiB

0	549
1	342

Frequency Table

Value	Count	Frequency (%)
0	549	61.6%
1	342	38.4%

Ticket
Categorical

HIGH CARDINALITY
UNIFORM

Distinct count	681
Unique (%)	76.4%
Missing	0
Missing (%)	0.0%
Memory size	7.1 KiB

CA. 2343	7
1601	7
347082	7
CA 2144	6
3101295	6
Other values (676)	858

Value	Count	Frequency (%)
CA. 2343	7	0.8%
1601	7	0.8%
347082	7	0.8%
CA 2144	6	0.7%
3101295	6	0.7%
347088	6	0.7%
S.O.C. 14879	5	0.6%
382652	5	0.6%
17421	4	0.4%
LINE	4	0.4%
Other values (671)	834	93.6%

Length

Max length	18
Mean length	6.750841751
Min length	3

Value	Count	Frequency (%)
Uppercase_Letter	16	45.7%
Decimal_Number	10	28.6%
Lowercase_Letter	6	17.1%
Other_Punctuation	2	5.7%
Space_Separator	1	2.9%

Value	Count	Frequency (%)
Latin	22	62.9%
Common	13	37.1%

Value	Count	Frequency (%)
ASCII	35	100.0%

Title
Categorical

HIGH CORRELATION

Distinct count	6
Unique (%)	0.7%
Missing	0
Missing (%)	0.0%
Memory size	7.1 KiB

Mr	525
Miss	185
Mrs	128
Master	40
Dr	7

Value	Count	Frequency (%)
Mr	525	58.9%
Miss	185	20.8%
Mrs	128	14.4%
Master	40	4.5%
Dr	7	0.8%
Rev	6	0.7%

Length

Max length	6
Mean length	2.745230079
Min length	2

Value	Count	Frequency (%)
Lowercase_Letter	7	70.0%
Uppercase_Letter	3	30.0%

Value	Count	Frequency (%)
Latin	10	100.0%

Value	Count	Frequency (%)
ASCII	10	100.0%

Family_Size
Real number (ℝ_≥0)

ZEROS

Distinct count	9
Unique (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.9046015712682379
Minimum	0
Maximum	10
Zeros	537
Zeros (%)	60.3%
Memory size	7.1 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	5
Maximum	10
Range	10
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.613458541
Coefficient of variation (CV)	1.783612358
Kurtosis	9.15966597
Mean	0.9046015713
Median Absolute Deviation (MAD)	0
Skewness	2.727441474
Sum	806
Variance	2.603248465

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	537	60.3%
1	161	18.1%
2	102	11.4%
3	29	3.3%
5	22	2.5%
4	15	1.7%
6	12	1.3%
10	7	0.8%
7	6	0.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	537	60.3%
1	161	18.1%
2	102	11.4%
3	29	3.3%
4	15	1.7%

Value	Count	Frequency (%)
10	7	0.8%
7	6	0.7%
6	12	1.3%
5	22	2.5%
4	15	1.7%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	Age	Cabin	Embarked	Fare	Name	Parch	PassengerId	Pclass	Sex	SibSp	Survived	Ticket	Title	Family_Size
0	22.0	NaN	S	7.2500	Braund, Mr. Owen Harris	0	1	3	male	1	0.0	A/5 21171	Mr	1
1	38.0	C85	C	71.2833	Cumings, Mrs. John Bradley (Florence Briggs Thayer)	0	2	1	female	1	1.0	PC 17599	Mrs	1
2	26.0	NaN	S	7.9250	Heikkinen, Miss. Laina	0	3	3	female	0	1.0	STON/O2. 3101282	Miss	0
3	35.0	C123	S	53.1000	Futrelle, Mrs. Jacques Heath (Lily May Peel)	0	4	1	female	1	1.0	113803	Mrs	1
4	35.0	NaN	S	8.0500	Allen, Mr. William Henry	0	5	3	male	0	0.0	373450	Mr	0
5	30.0	NaN	Q	8.4583	Moran, Mr. James	0	6	3	male	0	0.0	330877	Mr	0
6	54.0	E46	S	51.8625	McCarthy, Mr. Timothy J	0	7	1	male	0	0.0	17463	Mr	0
7	2.0	NaN	S	21.0750	Palsson, Master. Gosta Leonard	1	8	3	male	3	0.0	349909	Master	4
8	27.0	NaN	S	11.1333	Johnson, Mrs. Oscar W (Elisabeth Vilhelmina Berg)	2	9	3	female	0	1.0	347742	Mrs	2
9	14.0	NaN	C	30.0708	Nasser, Mrs. Nicholas (Adele Achem)	0	10	2	female	1	1.0	237736	Mrs	1

Last rows

	Age	Cabin	Embarked	Fare	Name	Parch	PassengerId	Pclass	Sex	SibSp	Survived	Ticket	Title	Family_Size
881	33.0	NaN	S	7.8958	Markun, Mr. Johann	0	882	3	male	0	0.0	349257	Mr	0
882	22.0	NaN	S	10.5167	Dahlberg, Miss. Gerda Ulrika	0	883	3	female	0	0.0	7552	Miss	0
883	28.0	NaN	S	10.5000	Banfield, Mr. Frederick James	0	884	2	male	0	0.0	C.A./SOTON 34068	Mr	0
884	25.0	NaN	S	7.0500	Sutehall, Mr. Henry Jr	0	885	3	male	0	0.0	SOTON/OQ 392076	Mr	0
885	39.0	NaN	Q	29.1250	Rice, Mrs. William (Margaret Norton)	5	886	3	female	0	0.0	382652	Mrs	5
886	27.0	NaN	S	13.0000	Montvila, Rev. Juozas	0	887	2	male	0	0.0	211536	Rev	0
887	19.0	B42	S	30.0000	Graham, Miss. Margaret Edith	0	888	1	female	0	1.0	112053	Miss	0
888	22.0	NaN	S	23.4500	Johnston, Miss. Catherine Helen "Carrie"	2	889	3	female	1	0.0	W./C. 6607	Miss	3
889	26.0	C148	C	30.0000	Behr, Mr. Karl Howell	0	890	1	male	0	1.0	111369	Mr	0
890	32.0	NaN	Q	7.7500	Dooley, Mr. Patrick	0	891	3	male	0	0.0	370376	Mr	0

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows